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As they pay more attention to accountability, funders 
and implementers of early childhood interventions are 
becoming more interested in comparing the benefits their 
programs produce and the costs they incur. RAND has 
issued a volume providing general guidance for perform¬ 
ing such analyses. The report (Assessing Costs and Benefits 
of Early Childhood Intervention Programs) also offers, as a 
case study, application of the guidance to a decision faced 
by the U.S. Substance Abuse and Mental Health Services 
Administration and the Casey Family Programs in pursu¬ 
ing their Starting Early Starting Smart (SPSS) program. This 
brief summarizes that guidance. 

DESIGNING THE EVALUATION 

If you are a decisionmaker beginning to think about 
measuring costs and benefits, you must first decide what 
you want to learn about the program in question. Do you 
want to be able to say 

• that the program will generate benefits worth X dollars 
to society for every Y dollars spent on it? 

• that the program will eventually save the government 
X dollars for every Y dollars spent on it? 

• that the program will generate X amount of health 
benefit (or education benefit, etc.) for every Y dollars 
spent on it? 

• that it will cost Y dollars to replicate the program (at a 
bigger scale or under different conditions)? 

If you are implementing the program whose value you 
wish to measure, it is important to make this choice as 
early as possible—^ideally, while elements of program 
planning are still under way. The reason? What you can 
learn from an analysis of costs and benefits could be limit¬ 
ed by the methods used to design the program. 

In particular, scientifically credible measures of bene¬ 
fits and costs require a comparison group. This is a group 
of children who are tracked along with the program partic- 
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ipants and who are as similar as possible to the latter 
except that they do not participate. Care must be taken in 
selecting these groups. The SESS program, for example, 
tests the effectiveness of integrating behavioral-health ser¬ 
vices into preschool education or primary health care for 
young children. The comparison groups, then, would be 
children similar to the SESS participants and enrolled in 
the same kind of preschool or receiving the same kind of 
primary health care, but without the integrated behavioral- 
health services. If you do not have a comparison group, 
you leave yourself open to the criticism that the benefits 
you measured could have been realized in the absence of 
your program. 

It will also be important to compare benefits and costs 
for the program you are analyzing with analogous mea¬ 
sures for other programs. That comparison is particularly 
important for the third question listed above, because if 
you come up with, for example, a given number of points 
gained on an emotional-development scale per $1,000 
invested, that would be meaningless unless it is compared 
with another program's performance. 

RESOURCE CONSIDERATIONS 

The choice you make among the alternative questions 
listed above will affect the amount of money and time that 
must be spent on the evaluation. This is well borne out by 
studies already completed. The figure on the back shows 
the social benefits and costs (in answer to the first question 
above) measured for three programs: Perry Preschool 
(Ypsilanti, Mich.), the Prenatal/Early Infancy Project 
(PEIP) (Elmira, N.Y.), and the Chicago Child-Parent 
Centers (CPCs). For all three of these programs, benefits to 
society far exceeded the costs, at least for the higher-risk 
elements of the served population. However, all of the 
evaluations tracked program participants and comparison 
groups for 14 years or more. Without these long follow-up 
periods, not all of these programs would have shown net 
benefits, because, although all costs have accrued once the 




intervention is over, benefits can continue to accumulate 
for years to come as the participants mature. For Perry 
Preschool, accumulated benefits did not catch up to pro¬ 
gram costs until the children were 20 years old. 
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There are ways to make the tally of benefits and costs 

more comprehensive without waiting such long periods: 

• Use mathematical models to take juvenile data and 
predict such future benefits as increased employment 
and reduced criminal justice involvement. 

• Include benefits (and costs) to the children's caregivers. 
These are legitimate benefits to society (and they were 
mainly responsible for the PEIP's net benefit). 

• Measure as many benefits as possible, including those 
associated with economic effects or involvement with 
the criminal justice system, which can be expressed in 
dollar terms, whereas others cannot and must be omit¬ 
ted. SESS evaluators, for example, have been princi¬ 
pally tracking indicators of emotional development. 
That is quite natural, given the intervention's aims. 
However, those indicators cannot be easily "mone¬ 
tized," and SESS planners will need to consider mea¬ 
suring other benefits as they design the cost-benefit 
phase of their evaluation. 


• Measure all costs. This is the flip side of benefit mea¬ 
surement and is necessary for a credible claim of net 
benefits. Costs measured should include not only bud¬ 
getary costs but off-budget social resources (such as 
the value of donated time or space) that could have 
been used for other purposes. 

Neither extended follow-up nor the steps needed to 
demonstrate net benefits in the interim are cheap. A sub¬ 
stantial commitment is required to measure net social ben¬ 
efits (or benefit-cost ratios) or net savings to government. It 
would be less onerous to demonstrate which of the several 
interventions is the most beneficial along a single dimen¬ 
sion (e.g., increased achievement test scores, decreased 
teen pregnancies) per dollar spent. If the resources avail¬ 
able to you are limited, such cost-effectiveness comparisons 
deserve consideration. And full, accurate measures of bud¬ 
getary costs alone (with no measurement of benefits) can 
sometimes be helpful in planning the implementation of a 
program in another site or at a larger scale. 

NOT THE FINAL WORD 

Regardless of which analytical approach you take, it is 
important to realize that, while a simple numerical com¬ 
parison (such as those in the figure) makes an attractive 
story, it is not the whole story. Benefits and savings may 
accrue to some stakeholders and not others. Various 
sources of uncertainty may make it difficult to predict with 
confidence that one program will be more cost-effective 
than another or that net benefits accruing from an inter¬ 
vention will recur when it is replicated under different 
circumstances. 

Benefit and cost analysis is a powerful tool to assist in 
the understanding of the relative social worth of different 
programs and in choosing which one might be the better 
investment. However, this tool is not comprehensive or 
precise enough to be the final arbiter. If you are deciding 
among intervention alternatives, you must also bring to 
bear your own values and subjective judgment and those 
of other stakeholders in the community. 


RAND research briefs summarize research that has been more fully documented elsewhere. The research summarized in this brief was carried out 
within RAND's Labor and Population Program in coordination with the RAND Child Policy Project Research results are described in detail in 
MR-1336-CFP, Assessing Costs and Benefits of Early Childhood Intervention Programs: Overview and Application to the Starting Early 
Starting Smart Program, by Lynn A. Karoly et at The results are summarized in MR-1336/1-CFP. Both documents are available electronically at 
www.rand.org/pubUcations/MR/MR1336/ or through RAND Distribution Services (Telephone: 310-451-7002; Fax: 310-451-6915; E-mail: 
order@rand.org). The documents and further information about the SESS program are available from the Casey Family Programs 
(www.casey.org/projects.htmttSESS) and SAMHSA (www.samhsa.gov). Abstracts of RAND documents may be viewed at www.rand.org. 
RAND® is a registered trademark. RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis; its 
publications do not necessarily reflect the opinions or policies of its research sponsors. 

RAND 

1700 Main Street, P.O. Box 2138, Santa Monica, California 90407-2138 • Telephone 310-393-0411 • FAX 310-393-4818 
1200 South Hayes Street, Arlington, Virginia 22202-5050 • Telephone 703-413-1100 • FAX 703-413-8111 
201 North Craig Street, Suite 102, Pittsburgh, Pennsylvania 15213 • Telephone 412-683-2300 • FAX 412-683-2800 
Newtonweg 1, 2333 CP Leiden, The Netherlands • Telephone 011-31-71-524-5151 • FAX 011-31-71-524-5191 

RB-5051-CFP(2001) 



